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APPARATUS AND METHOD FOR ADJUSTING REAL TIME VIDEO TO 
COMPENSATE FOR COLOR BLINDNESS 

BACKGROUND OF THE INVENTION 



1 . Field of the invention 
10 The present invention is related to the field of compensating for color vision 

anomalies of humans, and more specifically to real time video systems that adjust the color 
of the displayed images so as to present more color contrast within the range of perception 
of viewers suffering from color vision deficiencies. 



15 2. Description of the related art 

Color is used increasingly to encode visual information. A comprehensive 
description is found in a book titled Digital Color Management, Encoding Solutions, by 
Giorgianni and Madden, Addison Wesley, 1998. The book describes standards for 
representations of color in color space, such as those promulgated by CIE (Commission 
20 Internationale de F Eclairage) in various coordinate systems (-LUV, -XYZ, -LAB, etc.). 

It is well documented that, as compared to a healthy majority, a fraction of the 
population suffers from color vision deficiencies. These people are more commonly called 
color blind. Such deficiencies do not permit them, when viewing color images, to detect 
certain colors or discern color contrasts. 
25 Color blindness is discussed in an article titled "Color displays for the color blind", 

The Fifth Color Imaging Conference, pp. 17-22, by Jan Walraven and Johan W. Alferdinck, 
that is incorporated herein by reference. Importantly, color blindness is characterized in 
terms of a diagram that is reproduced herein as FIG. 1 . 

FIG. 1 is a chromaticity diagram in CIE-XYZ color space. This diagram appears in 
30 the art frequently in color. The range (gamut) seen by most people is within an RGB 

triangle, defined by corner points R (red), G (green), and B (blue). The colors are digitally 
distributed within this triangle which has an area N. 

The diagram also includes results of simulations of the perceptual constraints of 
anomalous color vision. As such, the diagram characterizes the visions of a protanomalous 
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and of a deuteranomalous observer as triangles having respective areas P and D. The 
colorblind do not see color or color contrast outside their triangle. 

The vision triangles of the color blind are smaller than, and substantially contained 
within the RGB triangle of a healthy person. The diagram thus properly presents 
colorblindness as a deficiency in range (gamut) of perception of color compared to the range 
of most people. 

It is desirable to generate real time video for digital TV and related applications, that 
is adjusted for colorblind people. 
/j£ • A"^S Little work has been done in this direction. U.S. Patent No. 5,598,898 addresses 
10 /color compensating for computer screens. However, even that patent admits that its own 
disclosure is not applicable to real time vi<|eo, such as TV screens and video screens 
(column 7, lines 2-7). 

[j BRIEF SUMMARY OF THE INVENTION 

J; ;f 15 The present invention overcomes these problems and limitations of the prior art. 

fy Generally, the present invention provides an apparatus and a method for adjusting 

12 real time video to compensate for color blindness. The apparatus of the invention is a video 

« system that includes a decoder which receives and decodes a video signal into original color 

, 2 signals. A processor receives the original color signals and outputs color signals that are 

20 adjusted for compensating for a selected one of a number of precharacterized types of color 
blindness. The invention further includes a screen that receives the adjusted color signals 
and displays images that are adjusted from the original, so as to compensate for the selected 
type of color blindness. 

The color signals are associated with respective series of ordered sets of samples that 
25 represent values of respective contents of red, green and blue color. The adjusted samples 
are derived from the original samples by one color gamut adjustment for each type of color 
blindness. 

The method of constructing the video system includes generating the mappings and 
storing them into the memory. The mappings are generated by characterizing at least the 
30 known, major color deficiencies, and then generating color gamut transforms to fit more 
range of actual color contrast within the range of perception of the color blind. Each color 
transform is stored in a memory as a mapping. 
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A processor is then placed within the signal path of the series of ordered sets of 
original samples for the red, green and blue, before they reach the screen. The processor 
uses the samples to look up from the memory adjusted samples for the screen. Further, 
software is implemented, to work preferably in conjunction with a remote control device of 
5 the screen. The software controls whether any color adjustment is to take place, and if so 
which one of the available mappings is to be used. 

The method of using the video system of the invention includes the user running the 
software. A static reference image of a full color palette is color transformed through each 
one of the mappings, to create respectively adjusted sample images. The reference image 
10 and the sample images are then shown to the viewer, who selects the one with the best color 
and color contrast for him. Then the system applies to the entire screen the mapping that 
was used to generate the selected image. 

The present invention opens up a world of more enjoyable TV viewing to color blind 
people. TV sets can be sold including the memory as an optional feature. The vast majority 
15 of colorblind people can adjust the TV in a way that shows them the images most rich in 
color. 

The foregoing and other objects, features and advantages of the invention will 
become more readily apparent from the following detailed description of a preferred 
embodiment which proceeds with reference to the drawings. 



FIG. 1 is a prior art chromaticity diagram in color space according to the CIE-XYZ 
convention, showing the relative color perception ranges of a healthy person (N), and two 
specific types of color blind people, namely a protanope (P), and a deuteranope (D). 



FIG. 3 is a flowchart describing a method according to the present invention. 
FIG. 4 is a black and white rendering of a color palette that can be used with the 
method of FIG. 3. 

FIG. 5 is a diagram of a screen according to the invention during a test step of the 
30 method of FIG. 3. 

FIG. 6 is a flowchart describing a method for generating a mapping according to the 
present invention. 



20 



BRIEF DESCRIPTION OF THE DRAWINGS 



25 



FIG. 2 is a block diagram of a video system made according to the invention. 
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FIG. 7 is a chromaticity diagram in color space according to the CIE-XYZ 
convention, showing a first gamut mapping performed according to the present invention by 
uniformly contracting the range N of a healthy person into a contracted range N\ so that 
more fits within the discernible range D of a deuteranope. 
5 FIG. 8 is a chromaticity diagram in color space according to the CIE-XYZ 

convention, showing a second gamut mapping performed according to the present invention 
by shifting and rotating a segment S of the range N of a healthy person into a location S' that 
is within the discernible range D of a deuteranope. 

10 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT(S) 

As has been mentioned, the present invention provides a video system and methods 
for outputting to a screen signals for displaying real time video that is adjusted from the 
original to compensate for the colorblind. 

The apparatus of the invention is now described with reference to FIG. 2. The 

15 apparatus includes a real time video system 10. System 10 includes a decoder 12 that is also 
known as primary color decoder and means for decoding a video signal. Decoder 12 
receives a real time video signal 14 that can be any real time video signal that has encoded 
original color images, such as a color TV signal. The decoder is made as is known in the art, 
or can be a decoder already present with a system that is being retrofitted according to the 

20 invention. 

Decoder 12 decodes signal 14 into at least one original color signal associated with a 
color of the original image. Preferably it decodes it into original color signals Rl, Gl, Bl. 
These signals can be in any set of colors that are designated as primary colors. Most 
commonly the designated primary colors are red, green and blue. These are so designated 

25 because they are also the fundamental colors seen by the human eye. 

In any event, the original color signal is associated with a series of ordered sets of 
original samples. The samples are voltages that encode values of content of color for each 
pixel of each frame in digital or analog form. If encoded in analog form, an A/D converter 
16 may also be necessary. They are ordered in the sense that each pixel is characterized by 

30 three in this case values, the first one for content of red, the second one for content of green 
and the third one for content of blue color. They are a series in that they are a series of data 
for the pixels of the stream of frames containing the original color images. The original 
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color signal is preferably decoded into the series of ordered sets of original samples by the 
decoder, A/D converter 16 if necessary, and the processor described below. 

System 10 further includes a processor 18. The processor is coupled with the 
decoder, and receives the series of ordered sets of original samples. The processor includes 
5 software features capable of performing various processes, and is also known as means for 
performing the various processes. A person skilled in the art of writing software will be able 
to implement the invention in view of the present description. 

In the preferred embodiment, the video system further includes a memory 20 that is 
coupled with the processor. The memory preferably includes a lookup table 22. The lookup 
10 table effectuates a color gamut adjustment for a first type of color blindness, as will be 
described in more detail below. The memory can be an EPROM, and the lookup table is 
stored by burning in the EPROM. 

The system may include means for combining the original samples rl, gl, bl, of a 
single ordered set (rl, gl, bl) to generate a single sample rlglbl for inputting into the 
1 5 memory. Combining can be by simply concatenating the samples to generate a new digital 
value, such as of fixed length. Alternately, the processor itself converts the color content 
values encoded in the three signals Rl, Gl, Bl, into a single value rlglbl. 

The single value rlglbl is used as an input to the lookup table of the memory, for an 
example as an address. The memory can read out a single sample r2g2b2 for each input 
20 ordered set of original samples, whether or not they have been encoded as a single value 

rlglbl. It is possible to have systems where each color is treated separately, but that would 
not be satisfactory. At the very least, it would deprive the designer of versatility in 
designing gamut adjustments for each type of color blindness, as will be appreciated below. 

If, as is preferred, the memory reads out a single sample r2g2b2 for each input 
25 ordered set of original samples, then from it there is extracted an ordered set of adjusted 
samples (R2, G2, B2). This can be performed by the processor, or a separate extraction 
means can be included. Extraction can be the inverse process of combining, although that is 
not necessary. 

There might not be an exact original value in the mapping for the original value 
30 provided. In this case a process of interpolation may be employed as known. 

The adjusted samples are values of contents of preferably the same primary colors, 
derived from the original samples by one color gamut adjustment for each type of color 
blindness. 
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Strictly speaking, the memory is not necessary. For some types of color blindness, 
the correcting gamut transforms may be accommodated computationally only, as will be 
appreciated from the example of FIG. 7 that is described in more detail below. Principles of 
analytic geometry can be applied. An advantage is that they will inherently perform all 
5 interpolation, which is not avoided by the memory look up method in the strictest sense. 

A real time series of adjusted samples is thus formed, that define an adjusted color 
signal. Therefore the adjusted color signal is associated with a series of ordered sets of 
samples adjusted from the original samples according to a first color gamut adjustment 
predefined for the first type of color blindness. At the very least, the processor outputs at 
10 least a first color signal adjusted from the original color signal for compensating for the first 
type of color blindness. 

System 10 further includes a screen 24 coupled with the processor. The screen is 
made as is known in the art. The screen is typically suitable for receiving video signal 14 
(before or after decoder 12), and for displaying the color images encoded in it. However, 
15 the screen now receives the adjusted color signal, and therefore displays in real time color 
images adjusted from the original images for the first type of color blindness. 

The idea of the invention is to include a color gamut adjustment stage in the signal 
path between signal 14 and screen 24, and display the resulting adjusted images. Depending 
on the exact screen selected, a signal encoder 26 may be needed to convert the series of 
20 adjusted samples into an adjusted color signal 28 suitable for the screen, as will be easily 

discerned by a person skilled in the art. In other words, signal 28 will be of the same format 
as signal 14, etc. 

Alternately, if the screen is suitable for receiving separate R, G, B signals, then the 
color gamut adjustment stage is placed as close to the screen as possible. 
25 According to the preferred embodiment, multiple lookup tables (also known as 

mappings or gamut mappings or transforms) can be stored in the memory, to compensate for 
multiple types of color blindness. Accordingly, the processor can output a second color 
signal that is adjusted from the original color signal for compensating for the second type of 
color blindness. 

30 The video system further includes means for selecting to output one of the first and 

the second adjusted color signals. The selecting means is preferably implemented by 
software 30 that can reside in the processor, or in another processor of the video system. 
The software controls whether any color adjustment is to take place, and if so which one of 
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the available gamut mappings is to be used. The software preferably works in conjunction 
with a remote control device of the screen. 

A general method of the present invention for adjusting real time color images that 
are encoded in a video signal, which is suitable for producing a display on a screen, 
5 comprises the following steps: 

First, the video signal is decoded into at least one original color signal associated 
with a color of the original image. Preferably more than one signals, one for each primary 
color, as described above. 

Then the original color signals are used to generate an adjusted signal according to a 
1 0 first transform associated with a first type of color blindness. This is preferably 
accomplished by using the lookup table of the memory, as described above. 

Then the adjusted signal is applied to the screen. This causes the screen to display 
% = color images that are adjusted from the original images for the first type of color blindness. 
I'd A more detailed method according to the present invention is now described with 

f £ 1 5 reference to FIG. 3 . 

is 

A 

According to step 32, a color reference image is selected and stored, preferably in the 
M memory. The color reference image is also called a palette. 

} i A black and white rendering of a sample palette is shown in FIG. 4, that is of a 

j== convenient rectangular shape. It is intended to depict colors in various (such as four) areas, 
u 20 and gradual transitions from one color to another. The transitions are for the viewer to 
% i evaluate contrast. As a person skilled in the art will easily understand, many palettes are 
possible. A preferred palette is one where a healthy person will see full color contrast in 
every area of it. Another possible palette is the image of FIG. 1 in full color, which is a 
standard found in many textbooks. An even more preferred palette is an actual scene 
25 selected to contain all the visible colors in good proportion. It is preferred because it will be 
easier to explain to the viewer what to look for. 

Returning to FIG. 3, according to step 34, mappings are stored in the memory. The 
mappings are preferably lookup tables. The tables are derived as is described below. 

According to step 36, the software, coupled with other screen control software asks 
30 the prospective viewer whether he desires color compensation. This preferably happens 

when the video system is turned on the first time, and then the questioning can be disabled. 
Or it can be enabled automatically once a year, to accommodate a new viewer, or a viewer 
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with gradually developing color blindness. If the viewer does not want it, then the software 
exits (step 38). 

The designer will appreciate that step 36 is not necessary. A TV manufacturer can 
implement all of the above, and call them "Color Contrast Selection Feature", without 
5 mentioning color blindness. The viewers might appreciate a better viewing option without 
comment. 

According to optional step 40, the software can inquire how many mappings have 
been stored. This permits adapting to an upgraded memory situation. The answer is a 
number N. 

10 Then the system gives options to the viewer, and permits him to select which types 

of correction he wants. This can be done serially. The preferred mode is to perform it 
simultaneously, as is described below. 

According to step 42, the screen is partitioned into N+l sections. For example, if 
three mappings are stored, the screen is partitioned into four sections. 
15 According to step 44, the reference image is shown in its original form, and through 

the N mappings, one in each of the sections of the screen. Preferably the software also 
displays a number in each section, for subsequent selection by the viewer. 

At the very least, the reference color image is used to generate at least one reference 
color signal associated with a color of the reference image, then an adjusted signal is 
20 generated from the reference color signal according to a tested transform associated with a 
tested type of color blindness, and then the adjusted signal is applied to the screen. This 
causes the screen to display a reference image adjusted for the tested type of color blindness. 

At that time, the screen appears as seen in FIG. 5. Screen 46 shows four color 
palettes, represented by shaded rectangles 48-1, 48-2, 48-3 and 48-4. Of those, 48-1 is 
25 identical to the palette of FIG. 4, while the other three are transformed. In addition, 

corresponding selection numbers 50-1, 50-2, 50-3 and 50-4 are displayed. A healthy person 
would immediately see the most contrast in 48-1, and thus would input the corresponding 
selection number 50-1, that is a "1". 

Returning to FIG. 3, according to step 54, the video system accepts an input from a 
30 viewer. The input is about which mapping is desirable, and is preferably made by a remote 
control unit. At the very least, the input is as to whether a shown adjusted reference image 
is desirable. As mentioned above, this input is typically from a remote control unit. 
According to step 56, the partitioning of the screen is undone. 
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According to step 58, the selected mapping is applied through the entire screen. It is 
saved as a default, until changed. 

The method of generating the mappings is now described with reference to FIG. 6. 
As a first step 62, a set of coordinates is selected for defining a color space. The example of 
5 CIE-XYZ will be used, although other sets are possible. 

As a second step 64, a type of color blindness is selected. A deuteranope will be 
selected for FIGS. 7 and 8, although again, that is not limiting. For the full practice of the 
invention, the process is repeated for all types of color blindness that will be stored in the 
memory. 

10 As a next step 66, the selected type of color blindness is characterized with respect to 

the coordinates as at least one discernible region in the color space. As seen in FIG. 1, for 
deuteranopia the discernible region is characterized as a triangle D that is largely within the 
normal range. 

As a next step 68, a color gamut adjustment is selected that maps at least one region 
15 outside the discernible region into the discernible region. This will be shown in greater 
detail with reference to FIGS. 7 and 8. 

As a next step 70, the mapping is generated. This includes generating 
correspondences between the original values and the adjusted values that perform the color 
gamut adjustment. These are numeric values for (% red, % green, % blue), as an ordered 
20 set, for each pixel of the palette (i.e. every possible screen color). 

As a next step 72, the original values and the adjusted values are stored in a look up 
table in the memory. It may be desirable to store the original values as addresses for the 
corresponding adjusted values. 

Two sample gamut adjustments will now be described with reference to FIGS, and 8. 
25 As already mentioned above, they are for a deuteranope. The same conventions are used as 
in FIG. 1, and for the same regions. 

Referring to FIG. 7, a gamut adjustment is shown where the entire healthy range N is 
uniformly contracted into a smaller region N\ This way more of it fits within the 
discernible range D of a deuteranope. This is computationally intensive, because every pixel 
30 of the palette is "moved". This method results in minimized color skews, which are also 

uniform. However, the color contrast between adjacent colors is uniformly less sharp within 
the discernible range. This method can be implemented by computational adjustment 
(instead of looking up in a memory) better than the method of FIG. 8. 
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Referring to FIG. 8, another gamut adjustment is shown where a segment S of the 
healthy range N is mapped into a location S' of the discernible range D of a deuteranope. 
Mapping involves shifting and/or rotating at least a portion of one of the regions. This 
method is computationally less intensive than that of FIG. 7, and local contrast is preserved. 
5 However, some features will be shown with a wholly unnatural color, and in the same color 
as other features. 

A person skilled in the art will be able to practice the present invention in view of the 
present description, where numerous details have been set forth in order to provide a more 
thorough understanding of the invention. In other instances, well-known features have not 
10 been described in detail in order not to obscure unnecessarily the invention. 

Having illustrated and described the principles of the invention in preferred 
embodiment(s) thereof, it should be readily apparent to those skilled in the art that the 
invention can be modified in arrangement and detail without departing from such principles. 
All modifications coming within the spirit and scope of the accompanying claims are 
1 5 claimed as follows. 
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